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We show explicitly the entropy reduction from a detailed fluctuation theorem for the general 
stochastic system driven by nonequilibrium process under feedback control. The effect of interaction 
of the feedback controller with the system is to reduce the entropy of the system. We define the 
entropy reduction for the single trajectory and show that the overall entropy production for the 
stochastic system with feedback control can be either positive or negative. The negative entropy 
production has been studied earlier for a simple system with velocity dependent feedback control 
[K. H. Kim and H. Qian, Phys. Rev. Lett. 93, 120602 (2004)]. Our general approach provides 
the overall positive or negative entropy production irrespective of velocity dependent and position 
dependent feedback control. 
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I. INTRODUCTION 



The evolution of the physical systems can be modified 
or controlled by repeated operation of an external agent 
called controller [l], The action of the controller is 
to regulate the system dynamics and increase its perfor- 
mance. The controller can operate on the system blindly 
or it can use information about the state of the system. 
The former is known as the open loop controller and the 
latter one is called as feedback or closed loop controller. 
The feedback controller measures the partial performance 
of the system, and its action on the system depends on 
the outcome of measurements [3|. Recent advances in 
nanotechnology allows the active control of the position 
and velocity of the single molecule by a feedback system 
[U, HI ■ The proper utilization of the information about 
the state of the system in feedback control effectively im- 
proves the system performance [IHH]- 

In last two decades, the concept of fluctuation theo- 
rems has become an active research area in statistical 
physics for advanced theoretical understanding and ex- 
perimental verifications @, Q. This theorem generally 
establishes the connections between the nonequilibrium 
stochastic fluctuations of system and its dissipative prop- 
erties. Further it establishes rigorous identities for the 
nonequilibrium averages of thermodynamic observables 
such as work, heat, entropy, or current [§4l0l]. 

Consider a system initially in equilibrium at temper- 
ature (inverse) /3 — 1/fcgT (kg is the Boltzmann con- 
stant) which is externally driven from its initial state to 
final state by nonequilibrium process. Let P[r(t)] be the 
probability of the phase space trajectory, T(t) for the sys- 
tem driven between the two states in forward direction. 



This satisfies the detailed fluctuation theorem [9rfl2l|. 
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where cr[r(£)] is the positive entropy production of the 
driven system and pt [r^ (t)] is the probability of the 
phase space trajectory T' (i), for the system driven in the 
reversed direction. This is the direct relation between the 
entropy production and the ratio of probabilities for the 
forward and the reversed trajectories [Tol Hlj. 

The presence of feedback control in a physical system 
in general modifies both the fluctuation theorem and 
the nonequilibrium averages such as Jarzynski equality 
5, 12]. We have shown recently that the feedback con- 
trol in a physical system should preserve the detailed 
fluctuation theorem if the system has the same feedback 
information measure in both directions (l3| . Our results 
are based on the assumption that the system with feed- 
back control should locally satisfy the detailed fluctua- 
tion theorem. Such an assumption leads to a positive 
entropy production from a detailed fluctuation theorem 
for the system with feedback control. However, the effect 
of the interaction of the controller with the system is to 
reduce the entropy of the system 0, Q which was not 
captured in our earlier results [ill ]. 

The entropy production can be positive or negative de- 
pending on the feedback control. The negative entropy 
production can happen generally in a system with veloc- 
ity dependent feedback control (VFC) such as molecular 
refrigerator [5| . There is a general belief that the entropy 
reduction in velocity dependent feedback control (VFC) 
is significantly different from the stochastic systems with 
position dependent feedback control (PFC) [5(. Since the 
entropy reduction in the system due to the information 
used by the feedback controller is quite general for both 
VFC and PFC, it will be worth to discuss the entropy 
reduction from a fluctuation theorem due to feedback 
control in a general framework. 
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In following a few works on the single trajectory en- 
tropy for the stochastic system 0,[l3,[3, m this paper, 
we define for the first time the entropy reduction of the 
single trajectory, and show explicitly the entropy reduc- 
tion from a detailed fluctuation theorem for the general 
stochastic system driven under feedback control. The ex- 
plicit appearance of the entropy reduction term in fluc- 
tuation theorem is an important result of this work. In 
addition, our approach allows one to compute the over- 
all positive or negative entropy production irrespective 
of PFC or VFC. 



II. SINGLE TRAJECTORY ENTROPY 
REDUCTION DUE TO FEEDBACK CONTROL 



The feedback control enhances our controllability of 
small thermodynamic systems QH^. Whenever the con- 
troller measures the partial state of the system, the result 
of the measurement determines the action of the con- 
troller. The additional information on the system pro- 
vided by the measurement further determines the state 
of the system. Suppose, the controller performs a mea- 
surement on a stochastic thermodynamic system at time 
t rn . Let T rn be the phase-space point of the system at 
that time, P[r m ] its probability, and y the measurement. 
Depending on the controller measurements, the outcome 
y can occur with a probability P[y] [12]. The informa- 
tion obtained by the controller can be characterized by 
the mutual (feedback) information measure [HI, [l3| , 



entropy reduction for the protocol X(t-y) as 



I[v, r m] = h 



P[y\r m ] 
P[y] 



(T r [T(t)] = h 



Px 



(3) 



(2) 



Here Pa* [r(t)] is the probability of the phase space tra- 
jectory for the system without feedback control driven by 
an arbitrary chosen switching protocol A* (see, Eq.((TJ)). 
It should be noted that prior to the controller mea- 
surement the feedback experiment initially started with 
the same protocol A* . Our definition of entropy re- 
duction has a definite meaning in the sense that if the 
system has no effect of feedback control, P\ {t . y) [T(t)] = 
Pa* [r(t)], which results in zero entropy reduction. How- 
ever, one can see latter from Eq.(|10p that there should 
be a single trajectory entropy production. If the 
driven system strongly influenced by the feedback con- 
troller, P\ {t . y) [r(i)] should be significantly different from 
PA*[r(t)], which eventually results in reduction in en- 
tropy H|. 

Starting from the same switching protocol A* one can 
perform the feedback control experiment in reverse di- 
rection by driving the system from the final equilibrium 
state of the forward switching process to its initial equi- 
librium state. Let P^*[rt(t)] be the probability of the 
phase space trajectory, (t) of the system without feed- 
back control driven in the reverse direction for the switch- 
ing protocol A* (see, Eq.(JTJ). For every trajectory in the 
forward direction there should be a corresponding tra- 
jectory in the reverse direction [914121] . If we perform the 
feedback controller measurements for a given system in 
the reverse direction, the single trajectory entropy reduc- 
tion in the reverse direction is 



where P[y|r m ] is the conditional probability of obtaining 
outcome y on condition that the state of the system is 
r 

^ TCI ■ 

In experiments and simulations, the path connecting 
the two states of the system in the time period r can 
be obtained by pulling the system from one state to an- 
other along a switching path. This can be parameter- 
ized using the switching protocol path variable A [1, [l2j . 
The switching rate determines whether the switching pro- 
cess is an equilibrium (infinitely slow) or nonequilibrium 
(fast) process. If the experiments are performed under 
feedback control, the switching control parameter A de- 
pends on the outcome y after t m [l2[ • That is, when- 
ever the controller makes measurements, there is a corre- 
sponding change in the switching parameter for the next 
time step, which is denoted as Xn. y y After each mea- 
surement, the value of outcome y should be fixed and the 
corresponding switching parameter \(p,y) does not change 
until the controller make the another measurement. 

Let P\ (t . y) [r(f)] be the probability of the phase space 
trajectory, T(t) in forward direction for the switching pro- 



tocol A 



Since the entropy of the system is reduced 



by feedback control Q, we define the single trajectory 



4[T\t)] 



-<r r \T(t)], 



(4) 



From the definition of Eq.©, the single trajectory en- 
tropy reduction in reverse direction is given by 



atp(t)} = In 



(5) 



where P\ [r^(t)] is the probability of the phase space 

trajectory in reverse direction for the switching protocol 
At. t w The measurement outcome ifi can occur with 

(t;j/t) u 

probability PT[yT]. The mutual information measure due 
to feedback control in reverse direction is given by 



P[y\Tl) = ln 



p%t] 



(6) 



where P^y^T^] is the conditional probability of obtain- 
ing outcome y' on the condition that the state of the 
system is T' m . 
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Using Eq.([T]), Eq.© can be rewritten as 



In 



In 



pi 

(ti»t) 



= -a[T(t)} + lr 



4 TO] 

(t;yt) 



Therefore, 



Pi [Tt(t)] 

(t;»t) 



= CT t[rt(t)] + (T [r(t)]. 



(7) 



The left hand side of the above equation can be rewritten 
as 



h 



+ In 



p\ t -jnt)} 

4 TO] 

<t;»t) 



4[Tt(t)]+a[r(t)]. (8) 
Using Eq.Q and Eq.dU, the above equation becomes, 



P\t; V ) [£wj _ e s r [r(t)] 
[Tt(t)] 



(t;» f ) 



where 



S r [T(i)] - -2a r [T(t)}+a[r(t)} 
whose reversed part 

St[rt(i)] = -5 r [T(t)]. 



(9) 



(10) 



(11) 



It is clear from Eq. (fTU|) that if the feedback control 
has no effect on the system, <7 r [r(t)] = 0, however, 
there should be a single trajectory entropy production 
S r [T(t)] = a[T(t)]. 

Under identical experimental conditions in the forward 
and reverse directions, we assume that the error in the 
controller measurements outcomes y and y 1 should be 
the same. In such a case, 

P[y] = P ] [y ] \- (12) 

Combining Eq.Q, Eq.© and Eq.(fl"2j). we can obtain 



PWt 



= e -r[3/,r m ]-/ + [y t ,rt i ]_ 



(13) 



For the controller measurement condition I[y,r m ] 
/^[j/^r^] [l3|, the above equation becomes, 



PMr m ] = pV|rtj. 



(14) 



If we obtained the same measurement outcome y' [H, [l3| 
of phase point V in the forward direction and T'^ in the 
reverse direction then Eq.© and Eq. (fl"4)) become, 



_ e Sr[T(t)] 



p[y'\r'] = pi[ y '\r% 



(15) 



(16) 



In what follows we use the above equations and obtain 
the overall entropy production from a detailed fluctuation 
theorem due to feedback control in both the directions. 



III. DETAILED FLUCTUATION THEOREM 
UNDER FEEDBACK CONTROL 

Let P[S r ] be the probability of obtaining S r [T] from 
the repeated feedback control experiment in the forward 
direction. This probability can be obtained from the joint 
distribution of T(t) and y is given by [TH, [l3j 



P[S r ] 



p[y'np\, vl) m] 

5(S r [T(t)} - S r [T}) dy' D[T(t)] 



(17) 



where S(x) is the Dirac delta function which has a prop- 
erty S(—x) — S(x). Using Eq. ([T5j) . the above equation 
becomes, 

P[S r ] - / e s ^P[y'\r']Pl, [rt(t)] 
5(S r [T(t)} - S r [T])dy' D[T(t)}, 



P[S r ] = e s ^] / P[y'\T']Pl [Tt(t)] 



S(S r [T(t)}-S r [f])dy' D[T(t)], 

Using Eq. ([Tll and Eq. (fi7j)) . the above integral can be 
rewritten as, 



P [s r ] = e s ^ / pny'|r't]pt [r t (t)] 



5(5t[rt(*)]-5t[rt] 

dy' D[T\t)]. 



(18) 



Since 8(-x) = 5(x) and Dp(t)} = D[T(t)] [3, we can 
obtain the overall entropy production from a detailed 
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fluctuation theorem under feedback control in both di- 
rections as 



P[S r ] 

pn-s r } 



(19) 



where P^[—S r ] is the probability of obtaining S$ [T^] from 
the repeated feedback control experiment in the reverse 
direction. This result explicitly provides the entropy re- 
duction in the controlled system due to the external agent 
that operates on it. We can rewrite Eq. tlTT)!) simply as 



P[-2a r + a] 

Pt[-(-2(T r + <7)] 



(20) 



From the above relation, we can discuss the different 
entropy reduction conditions as follows. If oy < a/2, S r 
is always positive, which provides the overall positive en- 
tropy production. It is clear that the positive entropy 
production as obtained in our earlier work fl3l j for the 
system with feedback control in both directions is a spe- 
cial case of the present derivation. If a r = er/2, the over- 
all entropy production is zero. This may be a condition 
for equilibrium [5]. If oy > a/2, S r is always negative, 
which provides the overall negative entropy production. 
This situation can happen quite generally in velocity de- 
pendent feedback control experiment (molecular refrig- 
erator) Q. This shows that our general result is valid 
for both the velocity dependent and position dependent 
feedback control. The overall entropy production can be 



positive or negative depending upon the interaction of 
the system with the feedback controller. 

Finally using Eq. (l20l) . it is straightforward to obtain 
the integral fluctuation theorem 



-2a r +a) 



) = 1- 



(21) 



If the feedback control has no effect on the system, 
ay = 0, then we get positive entropy production detailed 
fluctuation theorem 1151 



P[a] 



Ptf 



IV. CONCLUSION 



(22) 



We have defined the single trajectory entropy reduc- 
tion for the nonequilibrium stochastic system driven un- 
der feedback control. Our result fEal^U]) explicitly shows 
the entropy reduction from a detailed fluctuation theo- 
rem for a stochastic system driven under feedback con- 
trol. Our general result is valid for both the velocity 
dependent and the position dependent feedback control. 
This allows one to compute the overall entropy produc- 
tion which can be either positive or negative. 
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